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Abstract 

T his study compares the impact of ‘open’ and ‘anonymous’ peer 
feedback as an adjunct to teacher-mediated feedback in a digital 
online environment utilising data gathered on an academic writing course 
at a Turkish university. Students were divided into two groups with similar 
writing proficiencies. Students peer reviewed papers either anonymously or 
openly, then resubmitted them. The lecturer provided feedback and students 
again resubmitted their assignments. Finally, students submitted a reflection 
paper on how or whether they benefited from both peer and teacher-mediated 
feedback. Findings provide evidence for the positive contribution of multiple 
anonymous peer feedback in a digital online environment towards improved 
academic writing skills. 
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1. Introduction 


Peer review may allow learners to overcome problems they encounter in 
Foreign Language (FL) learning since they receive assistance and feedback 
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(Hanjani & Li, 2014), and the literature provides evidence for the effectiveness 
of peer review (e.g. Hu, 2005; Hu & Lam, 2010; Zhao, 2014). However, 
measuring the impact of such an implementation is not easy (Kleijn et 
al., 2013). The concept dates back to Vygotsky’s (1978) Zone of Proximal 
Development in which students learn from each other by interacting. Such 
interaction is also observable in the process called scaffolding (Weissberg, 
2006), where one peer may draw another peer’s attention to problematic 
aspects of a paper that had been overlooked (Ruecker, 2010). The expectation 
of the FL lecturer is to observe an improvement in the students’ writing skills, 
since this is assumed to be beneficial for both authors and reviewers (Aghaee 
& Hansson, 2013). 

Despite the theoretical benefits of peer review, lecturers need to be cautious 
of potential drawbacks. Feedback provided by students with limited FL 
proficiency may be misleading and result in students not trusting ‘weak’ 
peers’ feedback (Paulus, 1999; Rinehart & Chen, 2012; Rollinson, 2005; 
Ruecker, 2010; Saito & Fujita, 2004). In this case, a balanced distribution 
of asymmetrical feedback , from a proficient student to a less proficient one, 
and symmetrical feedback, between learners of almost equal skills, should be 
provided (Hanjani & Li, 2014). 

Distribution of student papers is the key element in applying the peer review 
process. Nowadays, digital technology is a tool at the disposal of writing 
instructors that not only enables several distribution options but also provides 
more effective feedback. Going beyond its original aim, Turnitin, a plagiarism 
detector, incorporated the PeerMark facility through which students are able to 
review each other’s papers. Since digital peer feedback is a new phenomenon, 
there is no consensus yet on the superiority of online feedback over traditional 
modes (Elwood & Bode, 2014). 

Digital feedback enables several features not possible in traditional practice. In 
particular, digital technology can remove student identification for anonymous 
peer review and provide review tools to students. Thereby, a lecturer can create 
more effective peer feedback opportunities by eliminating the social constraint 
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of face-to-face feedback (Ho & Savignon, 2007). In the literature, the only 
study regarding anonymity in a non-digital setting (Robinson, 2002) warns that 
anonymous peer review may not provide effective feedback if the process is not 
planned carefully. 


2. The study 

As a plagiarism detector, Turnitin was successful in reducing the ratio of 
plagiarism incidents on an academic writing course (Razi, 2014) taught 
by the researcher of this study. A related study revealed that students were 
unaware of their real problems since self-reported difficulties did not reflect 
their actual problems (Razi, 2015). The basic assumption in this study, that of 
retaining anonymity in the peer review process, is underpinned by Liou and 
Peng’s (2009) study where students were reluctant to highlight their friends’ 
errors. By enabling a balanced distribution of asymmetrical and symmetrical 
feedback, anonymity may enhance student participation and collaboration in 
EFL academic writing, leading to the exchange of more effective feedback, 
and contribute to improved writing skills. The research questions were as 
follows: 


• RQ1 : does the digital peer review process work effectively? 

• RQ2: should lecturers manage the peer review process openly or 
anonymously? 

• RQ3 : should lecturer- feedback precede or follow peer- feedback? 

2.1. Setting and participants 

The study was conducted in the English Language Teaching (ELT) department 
of Canakkale Onsekiz Mart University (COMU), Turkey, in the fall term of 
2014. Fifty-nine trainee teacher students who attended the academic writing 
skills course regularly in three intact classes taught by the researcher were 
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included in the study. They were assigned either to the experimental or control 
group, based on scores from their first assignment. There were 30 participants 
(« ma i = 9, n f , =21) in the experimental group (anonymous peer review) and 
29 participants (« male = 9, « (cmale =20) in the control group (open peer review). 
Independent samples t test did not indicate significant differences between the 
two groups’ mean values on the first assignment. The participants’ mean age 
was 19. 

2.2. Materials 

As a digital environment, Turnitin was used for three basic reasons. Firstly, COMU 
had an institutional Turnitin license, secondly Turnitin was superior in detecting 
plagiarism (Hill & Page, 2009), and thirdly, it enabled peer review facilities. 

2.3. Procedures 

During the semester, students submitted three different written assignments, 
each of approximately 500 words. Assignment 1 was used for setting up groups 
and familiarizing students with the digital peer review process. 

in Assignment 2, before matching students, they were grouped into three; namely, 
‘good’, ‘moderate’, and ‘weak’, with reference to their scores in Assignment 1. 
Then, each student received feedback from a ‘good’, ‘moderate’, and ‘weak’ 
peer; and provided feedback to a ‘good’, ‘moderate’, and ‘weak’ paper. 

The students were aware of this categorization but did not know into which 
category they were placed. They revised their papers and submitted second 
drafts on which they received lecturer feedback. Then they submitted the final 
version. 

A similar procedure was followed in Assignment 3 with a change. They 
received lecturer feedback before peer feedback. Following this, they handed 
in a reflection paper outlining how or if they had benefited from the digital 
feedback. 
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3. Findings and discussion 

3.1 . RQ1 : does the digital peer review 
process work effectively? 

The digital peer review facility can be said to work effectively in a digital online 
environment where lecturers and students are both familiar with the digital tools 
involved. However, to facilitate the process, Turnitin should enable the grouping 
of students according to writing proficiency and then provide multiple matching 
from each group since matching students manually is a very complicated task 
for the lecturer. 

3.2. RQ2: should lecturers manage the peer review 
process openly or anonymously? 

Independent samples Mest results did not indicate significant differences 
between the experimental and control group’s mean scores on either the second 
or third assignments. However, data from reflection papers revealed that students 
preferred digital feedback in comparison to manual. In addition, the participants 
indicated their preference for feedback from multiple peers, not just a single 
person. This is invaluable both for the author and reviewer (Aghaee & Hansson, 
2013). Good students in particular indicated they did not benefit from single- 
peer reviews. Regarding open peer review, they emphasised that they avoided 
criticizing their peers since it felt like giving feedback to a friend. However, 
when it came to anonymous peer review, they felt like a teacher giving feedback 
to a student. Thus, students’ relations with their classmates have an impact on the 
quality of feedback in open peer review. Giving feedback also contributes to the 
classroom management skills of these trainee teachers. 

3.3. RQ3: should lecturer-feedback 
precede or follow peer-feedback? 

Data from reflection papers highlighted that students preferred lecturer feedback 
after peer feedback, not before it. Such a preference emphasises the dominant 
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role of the lecturer, as students prefer final responsibility to be with someone in 
authority rather than a friend. Students also mentioned that receiving lecturer- 
feedback helped them appreciate peer-feedback. 


4. Conclusion and implications 

Firstly, the digital environment used ( Turnitin ) facilitates the management 
of exchanging feedback. Considering the first-year undergraduates’ 
inexperience in academic writing, enabling multiple digital feedback would 
be beneficial. 

Secondly, the most important contribution of digital feedback is the possibility 
of exchanging feedback anonymously. This enables students to make a more 
honest critique of each others’ work. Otherwise, while exchanging peer- 
feedback openly, they withhold commenting on their peers’ weaknesses 
to avoid problems in daily relations. Moreover, anonymous peer-feedback 
should be provided from several peers selected in accordance with their 
writing proficiency. Single-matches can be demotivating due to the risk of 
being matched with a less proficient peer who cannot provide beneficial 
feedback. 

Finally, lecturer feedback should be provided after peer feedback. 
Participants’ comments indicated this makes them feel much safer. In sum, 
a combination of “self-, peer, and tutor [review is needed] to help students 
make informed decisions about [revising] their early drafts and [reflecting] 
upon the strengths and weaknesses of their writing development” (Lam, 
2013, p. 446). 


5. Acknowledgements 

My very special thanks go to Graham Lee for language editing the earlier 
version of the manuscript. 


54 


Salim Razi 


References 

Aghaee, N., & Hansson, H. (2013). Peer portal: quality enhancement in thesis writing using 
self-managed peer review on a mass scale. The International Review of Research in Open 
and Distance Learning, 14( 1), 186-203. 

Elwood, J. A., & Bode, J. (2014). Student preferences vis-a-vis teacher feedback in 
university EFL writing classes in Japan. System, 42, 333-343. http://dx.doi.Org/10.1016/j. 
system. 20 13. 12.023 

Elanjani, A. M., & Li, L. (2014). Exploring L2 writers’ collaborative revision interactions 
and their writing perfonnance. System, 44,101-114. http://dx.doi.Org/10.1016/j. 
system. 2014. 03. 004 

Hill, J. D., & Page, E. F. (2009). An empirical research study of the efficacy of two plagiarism- 
detection applications. Journal of Web Librarians hip, 3(3), 169-181. http://dx.doi. 
org/ 10.1080/193 22900903 051011 

Ho, M. C., & Savignon, S. J. (2007). Face-to-face and computer-mediated peer review in EFL 
writing. CALICO Journal, 24(2), 269-290. 

Hu, G. (2005). Using peer review with Chinese ESL student writers. Language Teaching 
Research, 9(3), 321-342. http://dx.doi.org/10.1191/13621688051rl69oa 

Hu, G., & Lam, S. T. E. (2010). Issues of cultural appropriateness and pedagogical efficacy: 
exploring peer review in a second language writing class. Instructional Science, 33(4), 
371-94. http://dx.doi.org/10.1007/sll251-008-9086-l 

Kleijn, R. A. M., Mainhard, M. T., Meijer, P. C., Brekelmans, M., & Pilot, A. (2013). Master’s 
thesis projects: student perceptions of supervisor feedback. Assessment & Evaluation in 
Higher Education, 33(8), 1012-1026. http://dx.doi.org/10.1080/02602938.2013.777690 

Lam, R. (2013). The relationship between assessment types and text revision. ELT Journal, 
67, 446-458. http://dx.doi.org/10.1093/elt/cct034 

Liou, H. C., & Peng, Z. Y. (2009). Training effects on computer- mediated peer review. System, 
37(3), 514-525. http://dx.doi.Org/10.1016/j.system.2009.01.005 

Paulus, T. M. (1999). The effect of peer and teacher feedback on student writing. Journal 
of Second Language Writing, 3(3), 265-289. http://dx.doi.org/10.1016/S1060- 
3743(99)80117-9 

Razi, S. (2014). Plagiarism detectors in undergraduate academic writing assignments. Paper 
presented at the 14th International Language, Literature and Stylistics Symposium, 15-17 
October, Izmir, Turkey. 


55 


Chapter 6 


Razi, S. (20 15). Cross-checked problems in undergraduate academic writing. In K. Dikilita§, R. 
Smith, & W. Trotman (Eds.), Teacher-researchers in action (pp. 147-161). Kent: IATEFL. 

Rinehart, D., & Chen, S. J. (2012). The benefits of a cycle of corrective feedback on L2 writing: 
improving Taiwanese technological university students ' English writing proficiency. 
Saarbriicken, Germany: Lambert Academic Publishing. 

Robinson, J. M. (2002). In search of fairness: an application of multi-reviewer anonymous 
peer review in a large class. Journal of Further and Higher Education, 26(2), 183-192. 
http://dx.doi.org/10.1080/03098770220129451 

Rollinson, P. (2005). Using peer feedback in the ESL writing class. ELT Journal, 59(1), 23-31. 
http://dx.doi.org/10.1093/elt/cci003 

Ruecker, T. (2010). The potential of dual-language cross-cultural peer review. ELT Journal, 
65(4), 398-407. http://dx.doi.org/10.1093/elt/ccq067 

Saito, H., & Fujita, T. (2004). Characteristics and user acceptance of peer rating in 
EFL writing classrooms. Language Teaching Research, 5(1), 31-54. http://dx.doi. 
org/10. 1 191/1362 1 688041r 1 33oa 

Vygotsky, L. S. (1978). Mind in society: the development of higher psychological processes. 
Cambridge, MA: Harvard University Press. 

Weissberg, R. (2006). Scaffolded feedback: theoretical conversations with advanced L2 
writers. In K. Hyland & F. Hyland (Eds), Feedback in second language writing: Contexts 
and issues (pp. 246-265). Cambridge: Cambridge University Press, http://dx.doi. 
org/10. 1017/CBO978 1 1 39524742.01 5 

Zhao, H. (2014). Investigating teacher-supported peer assessment for EFL writing. ELT 
Journal, 68(2), 155-168. http://dx.doi.org/10.1093/elt/cct068 


56 



search-publishing.net 


Published by Research-publishing.net, not-for-profit association 
Dublin, Ireland; Voillans, France, info@research-publishing.net 

© 2016 by Cecilia Goria, Oranna Speicher, Sascha Stollhans (collective work) 

©2016 by Authors (individual work) 

Innovative language teaching and learning at university: enhancing participation and collaboration 
Edited by Cecilia Goria, Oranna Speicher, Sascha Stollhans 

Rights: All articles in this collection are published under the Attribution-NonCommercial -NoDerivatives 
4.0 International (CC BY-NC-ND 4.0) licence. Under this licence, the contents are freely available online as 
PDF files (http://dx.doi.org/10.14705/ipnet.2016.9781908416322) for anybody to read, download, copy, and 
redistribute provided that the author(s), editorial team, and publisher are properly cited. Commercial use and 
derivative works are, however, not permitted. 


Disclaimer: Research-publishing.net does not take any responsibility for the content of the pages written by the 
authors of this book. The authors have recognised that the work described was not published before, or that it 
was not under consideration for publication elsewhere. While the information in this book are believed to be true 
and accurate on the date of its going to press, neither the editorial team, nor the publisher can accept any legal 
responsibility for any errors or omissions that may be made. The publisher makes no warranty, expressed or 
implied, with respect to the material contained herein. While Research-publishing.net is committed to publishing 
works of integrity, the words are the authors’ alone. 

Trademark notice: product or corporate names may be trademarks or registered trademarks, and are used only 
for identification and explanation without intent to infringe. 

Copyrighted material: every effort has been made by the editorial team to trace copyright holders and to obtain 
their permission for the use of copyrighted material in this book. In the event of errors or omissions, please notify 
the publisher of any corrections that will need to be incorporated in future editions of this book. 

Typeset by Research-publishing.net 

Cover design and frog picture by © Raphael Savina (raphael@savina.net) 

ISBN13: 978-1-908416-31-5 (Paperback - Print on demand, black and white) 

Print on demand technology is a high-quality, innovative and ecological printing method; with which the book is 
never ‘out of stock’ or ‘out of print’. 

ISBN13: 978-1-908416-32-2 (Ebook, PDF, colour) 

ISBN 13: 978-1-908416-33-9 (Ebook, EPUB, colour) 

Legal deposit, Ireland: The National Library of Ireland, The Library of Trinity College, The Library of the 
University of Limerick, The Library of Dublin City University, The Library of NUI Cork, The Library of NUI 
Maynooth, The Library of University College Dublin, The Library of NUI Galway. 

Legal deposit, United Kingdom: The British Library. 

British Library Cataloguing-in-Publication Data. 

A cataloguing record for this book is available from the British Library. 



Legal deposit, France: Bibliotheque Nationale de France - Depot legal: janvier 2016. 



